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TECHNICAL FIELD 

This application relates in general to computer systems, and in specific to dynamic 
allocation of computer resources among applications. 
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BACKGROUND 

Computer systems inherently have hmited resources, particularly CPU resources. 
These limited resources must be allocated among the different applications operating within 
the system. A prior allocation mechanism for allocating system resources to applications is a 
5 system known as Process Resource Manager (PRM) 10 as shown in FIGUREIA. It is used to 
partition the CPU resource 1 1 and various other resources among the different applications 
12, 13, 14. The PRM partitions the resources into fractions of the whole, which are expressed 
as percentages in PRM configuration, as shown in FIGURE IB. The fractions or pieces are 
then assigned to groups of processes, which comprise applications. Each application would 
10 then receive some portion of the available resources, particularly the CPU. 

The PRM is a static mechanism, meaning that the allocation configuration is fixed by 
an administrator, and can only be changed by an administrator. In other words, the 
administrator specifies where the partitions should he, i.e., what percent of the machine goes 
to application 12, application 13, and application 14. This information is fixed, so what it 

15 cannot do is respond to changes in the needs of the different applications. For example, one 
application may be mostly idle, but occasionally has a large amount of work to do. Under the 
static mechanism with fixed entitlements, this application would be allocated a smaller 
fraction of the CPU resources, as a larger fraction can not be justified because of the large 
amount of idle time. Consequently, when the large amount of work is received, then the 

20 application's performance will suffer because of its low entitlement. Therefore, the 

transactions will take longer to process. Another example is where a transaction requires 
large amounts of resources for extended periods of time, but also has periods of idle time. 
Under the static mechanism with fixed entitlements, this application would be allocated a 
larger fraction of the CPU resources. Consequently, when this application is idle, other 

25 applications' performances will suffer, as this application is assigned a large amount of 

resources that are not being used, and thus are not available for other applications. Therefore, 
the other transactions will take longer to process. Thus, this mechanism caimot handle 
changes in the requirements of the different applications. 
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Another problem is the partitioning the resources by the administrator. The 
administrator has to think in terms of the actual machine resources and the requirements of 
the different applications. This is problematic because the resources and applications are 
operating at a lower level than what a person typically views. Moreover, the administrator 
5 has to have a great deal of knowledge of the application's characteristics and its resource 

requirements in order to determine where to set the partitions. Lack of knowledge is typically 
made up with guesswork. For example, an administrator may choose to set application 13 at 
20% of the CPU resources. If the users of the system complain, the administrator may 
change the value later on, 

10 An alternative mechanism is taught in patent by IBM, U.S. Patent Number 5,675,739, 

which is hereby incorporated by reference. The IBM mechanism uses a priority-based model 
to process application. In other words, high priority applications are serviced from a queue 
before lower priority application. This mechanism can change the priorities to adjust 
processing performance. 

15 Therefore, there is a need in the art for a non-static system that does not suffer from 

the problems discussed above, but allows for partitioning of the resources among the different 
applications. 
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SUMMARY OF THE INVENTION 

These and other objects, features, and technical advantages are achieved by a system 
and method that dynamically responds to changes in workload characteristics. The inventive 
mechanism also allows the administrator to think in terms of performance goals rather than 
5 machine resources and requirements. Consequently, the administrator defines a variety of 
performance goals with different priorities between them, and the inventive mechanism will 
make any necessary adjustment of the resources. For example, a goal for a database could be 
that a retrieval transaction should not take more than 10 milliseconds. The inventive 
mechanism would then manipulate the resources to achieve this goal. 

10 The inventive mechanism includes a work load manager (WLM) that receives goal 

information and priority information fi'om a user or administrator. The WLM also receives 
performance information fi"om performance monitors, which are processes that monitor the 
performance of the applications. The WLM examines the information fi-om the performance 
monitors and compares the information with the goals. Based on the comparison, the WLM 

15 may increase, decrease, or leave unchanged, a partial application's partition. If the 

performance of an application is lagging, e.g., if transactions are taking longer than the goal, 
then the WLM increases the entitlement. If an application is over-achieving, then the WLM 
will decrease its entitlement and allocate it to another application. 

To perform the comparison between the goals and the performance information, the 
20 WLM uses a control system that is common in control theory known as a Proportional 
Integral and Derivative controller, or PID controller. For further information in PID 
controllers, please see the reference by Benjamin C. Kuo entitled "Automatic Control 
Systems", 4^*^ ed., 1982, Prentice-Hall Inc., Englewood CHffs, N.J., 07632, ISBN 0-13- 
054817-0, which is incorporated herein by reference, particularly chapter 8.2. The 
25 proportional component will make large changes to the entitlements if there are large 
differences between the entitlements and the goals, and will make small changes to the 
entitlements if there are small differences between the entitlements and the goals. Tuning 
provides the proportionality between the change to the entitlement and the difference between 
the goal and the entitlement. For example, if the tuning constant is 10, then a one second 
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difference would result in a 10% change, while a two second difference would result in a 20% 
change. The derivative component is used to detect and compensate for 'ramping' changes. 
For example, if a transaction is taking 6 seconds, then 7 seconds, and then 8 seconds, the 
proportional controller will never catch up with the difference. The integral controller 
5 stabilizes the effects of the proportional controller and the derivative controller and eliminates 
any steady-state error. 

The invention applies PID control principles to workload management for discrete 
operations, e.g. intervals of time. The invention creates a feedback loop between application 
performance and CPU entitlements. Based on the reported information, the invention makes 

10 changes to the entitlements of the application to meet the stated goals. The changes will 

modify the performance of the application to bring the performance closer to the stated goals. 
The amount or magnitude of the changes is based on the tuning inputs. If the application's 
needs are not changing, then the invention will modify the entitlements to automatically settle 
in to the resource configuration that gives the application what it needs to achieve the goal. If 

15 the application's needs are changing, for example due to a change in its demand, system 
resources, or other factors, then the invention will react to any subsequent performance 
changes and bring the applications performance in line with the stated goals. 

An arbiter allocates the resources between the different applications, based on the 
priorities of the applications. Applications of equal priority are treated equally. The requests 
20 of higher priority applications are satisfied before lower priority applications. 

It is a technical advantage of the invention that entitlements are no longer a fixed 
configuration. As the application's needs change, the computer will automatically adjust 
entitlements based on what the user desired through the stated goals. This makes it into a 
dynamic system. 

25 It is another technical advantage of the invention that an administrator no longer has 

to estimate the initial entitlements as the invention will determine the correct resource 
allocation to achieve the stated goal, and the system will converge on a certain entitlement 
value that achieves the stated performance goal. 
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It is a further technical advantage of the invention that priorities can be assigned to the 
different goals. Consequently, different goals can be met based on system resources, e.g., 
with a high amount of resources, all goals can be met, however, with a lesser amount of 
resources the higher priority goal will be met before the lower priority goals. 

5 It is a still further technical advantage of the invention that changes to the system can 

be made as soon as the WLM detects performance changes, and action by the system 
administrator is not required. 

The foregoing has outlined rather broadly the features and technical advantages of the 
present invention in order that the detailed description of the invention that follows may be 
^ f 10 better understood. Additional features and advantages of the invention will be described 

hereinafter which form the subject of the claims of the invention. It should be appreciated by 
I J those skilled in the art that the conception and specific embodiment disclosed may be readily 

. 'S, utilized as a basis for modifying or designing other structures for carrying out the same 

purposes of the present invention. It should also be realized by those skilled in the art that 

si 

l3 15 such equivalent constructions do not depart from the spirit and scope of the invention as set 
=:i ; forth in the appended claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, and the advantages 
thereof, reference is now made to the following descriptions taken in conjunction with the 
accompanying drawing, in which: 

FIGURE 1 A depicts a prior art resource manager; 

FIGURE IB depicts the portioning of the applications; 

FIGURE 2 depicts the inventive work load manager; 

FIGURE 3 depicts the components of the inventive work load manager of FIGURE 2; 

FIGURE 4 depicts the inventive work load manager converging to a goal from low 
entitlement; 

FIGURE 5 .depicts the inventive work load manager converging to a goal from high 
entitlement; 

FIGURE 6 depicts an instability from excessive tuning for the proportional controller; 

FIGURE 7 depicts a block diagram of a computer system which is adapted to use the 
present invention; 

FIGURE 8 depicts a flow chart of the operations of the arbiter of the work load 
manager of FIGURE 3; 

FIGURE 9 depicts an example of allocation of entitlements by the work load manager 
of FIGURE 2; 

FIGURES lOA and lOB depict another example of allocation of entitlements by the 
work load manager of FIGURE 2; 

FIGURES 1 1 A and 1 IB depict a ftirther example of allocation of entitlements by the 
work load manager of FIGURE 2; and 

FIGURES 12 A, 12B, and 12C depict the operation of the rounder of the work load 
manager of FIGURE 3 . 
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DETAILED DESCRIPTION 

FIGURE 2 depicts the various components of the inventive system, which includes 
perfomiance goals 21. Goals 21 comprise a configuration file, which is defined by a user or 
system administrator, that describes the users preferences with regards to what 
5 characteristic(s) of the application is of interest and is being measured, what is the desired 

level of performance of the application in terms of the characteristic, and what is the priority 
of achieving this goal. A user can also specify time periods for a particular goal to be in 
effect. For example, a first application may be a first database and the user will specify in the 
configuration file that the characteristic is for a particular type of transaction to be completed 

10 within two seconds, and have a high priority. The application may also have a second goal 
for the same characteristic, e.g. the same type of transactions are to be completed within one 
half of a second, and have a low priority. A second application may be a second database 
which has a similar goal as that of the first database, namely for a particular type of 
transaction to be completed within two seconds, and have the same priority as the first 

1 5 database. Thus, resources would be partitioned between the two applications, so that the high 
priority goals will be met, and any excess resources would be given to the first application so 
that it can meet the lower priority "stretch" goal. 

The WLM 20 also receives performance information which describes the status of a 
particular characteristic or characteristics of each application 12, 13, 14 that is being 

20 monitored. This information is supplied by performance monitor 23. As shown in FIGURE 
2, a single monitor is capable of handling multiple applications, however, a different 
embodiment of the present invention may have multiple monitors, each monitoring one or 
more applications. The performance monitor 23 is a small program that gathers specific 
information about the application. For example, if the apphcation is a database, then a 

25 performance monitor measures access times for the database. This information is being 

gathered continuously while the system is operating. The workload manager will sample the 
information at some interval specified by the administrator. 

The output of the workload manager, derived from the ongoing performance reported 
by the monitor and given the goals the user, is periodically applied to the PRM 10. The 
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output of the WLM 20 is the share or entitlement allocation to the different resources that is 
assigned to each application. Generally, each percentage approximately equates to 1/100 of a 
CPU operating second. Thus, within a second, an application having an entitlement of 1 0 
will receive 1/10 of the second, provided that the application has at least one runable process. 
5 Note that the time received may not be consecutive, but rather may be distributed across the 
one second interval. 

The system may have multiple CPUs. Thus, the allocation can be placed all on one 
processor, one each processor, or on a portion of the processors. For example, a ten percent 
allocation in a four processor system could result in forty percent of one processor, ten 

10 percent of each processor, twenty percent of two processors, or some other allocation. The 

allocation among the different processors is determined by the PRM 10. The PRM will move 
the application around to various CPUs, as needed to attempt to ensure that it achieves ten 
percent. Therefore, if the application has only one runable thread, so that it can only execute 
on one CPU, then PRM will attempt to give it 20% of one CPU (on a two CPU system), so 

15 that is 10% of the total universe of CPU availability that is out there. Multi-threaded 

applications can be assigned to more than one CPU. The allocation allows the application to 
perform its programmed tasks. How fast and efficient it performs its tasks is a reflection of 
how much CPU time it was allocated. The less CPU it is allocated, the less it will perform in 
a time period. The more CPU it is allocated, the more it will perform in a time period. The 

20 performance monitor will measure its performance, which will be sampled by the WLM, thus 
completing the feedback of the system. 

The workload manager accomplishes its tasks by comparing the information fi-om the 
performance monitor with the goal the specified by the user. As stated before, there may be 
multiple goals for a single application. An easy goal and a stretch goal is one way of looking 
25 at this situation. There is one PID controller instance created within the workload manager 
for each goal that they are trying to achieve. Some instances may be looking at the same 
stream of performance data and reacting to it in different ways, depending on what they are 
trying to achieve. For example, if you look at the database performance as the characteristic 
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being measured, then one PID controller may be trying to get that characteristic to two 
seconds, while the other controller is trying to reduce it one second. 

Each PID instance performs the proportional-integral-derivative calculation on the 
received data to determine an R-value. The PID instance calculates Ri= (KP x P/) + {KD x 
5 + (KIxIJ +Rpld, KP, KD, KI, are tuning constants 22 set by the user or administrator of 

the system. 

The (KP X Pi') factor of the R equation represents the proportional contribution to the 
R value. KP is a tuning constant 22. P/ is a value for the difference between the goal and the 
measured result, and is calculated as follows. is the current value of the metric or 

10 characteristic for a particular goal "i", and is the desired value or goal for that metric. For 
example, using the database example, Pi = 1.8 sec/transaction, and = 2 sec/transaction is 
the goal. P/ equals - F,. Note that this assumes that the comparison operator (the in 
= 2) is "less than", meaning that an increase in entitlement shares will decrease the service 
level, i.e. decrease the measurement (see FIGURES 4 and 5). This may be indicated by 

15 showing the 'sign of the goal, e.g. = 2, be depicted as '<', for an expression of Fj < 2. 
However the goal would still be to have the characteristic approximately equal 2. If the 
operator is "greater than", meaning that an increase in entitlement shares will increase service 
level, i.e. increase the measurement, then P/ equals F, - P,. To indicate a "greater than" 
comparison operator a would be used. Note that another way of viewing "greater than" 

20 and "less than" is that "greater than" means good performance has larger numbers, and "less 
than" means good performance has small numbers. Generally, time-based characteristics are 
"less than" meaning the shorter the time, the better the performance, whereas transactions per 
second characteristics are "greater than" where the larger the number the better the 
performance. The value of KP reflects the aggressiveness of the user or administrator in 

25 addressing a problem. As the service level deviates, a large value of KP (aggressive) will 
provide for a big change to try to return to the goal quickly, while a small value of KP 
(conservative) will provide for a small change which causes a slower return to the goal. In 
other words, KP controls convergence. The choice of that value is based on some empirical 
information about the range of possible performance levels that we can get out of the 
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performance monitor. For further information, please see the reference by Benjamin C. Kuo 
entitled "Automatic Control Systems", 4'*^ ed., 1982, Prentice-Hall Inc., Englewood Cliffs, 
N.J., 07632, ISBN 0-13-054817-0, which is incorporated herein by reference. 

The (KI X Q factor of the R equation represents the integral contribution to the R 
5 value. A7 is a tuning constant 22. /, is a value for that accumulates previous proportional 
results over time, and is calculated as follows. /, = (Ipld x IH^ + P/. Ipld is the stored, 
previous value for/,. ///, is an integral history constant, which is another tuning constant 22. 
The integral history term should be a value between 0 and 1, inclusive, and serves to make 
older values contribute less to the integral contribution as time passes. Note that each time it 

10 is being multiplied by another factor of so the value is exponentially shrinking each 

iteration's contribution as time passes. This factor accumulates the P/ terms by adding old 
values with the new value. This integrates the difference between the service level and the 
goal over time. This factor is useful if the service level is a little bit off over a long amount of 
time, as this factor will eventually add up to bring the service level up/down to the goal. KI 

1 5 should be selected to properly set the effects of the integration factor. For further 

information, please see the reference by Benjamin C. Kuo entitled "Automatic Control 
Systems", 4^*^ ed., 1982, Prentice-Hall Inc., Englewood CUffs, N.J., 07632, ISBN 0-13- 
054817-0, which is incorporated herein by reference. An analogy is in the frequency domain, 
KI and KD will form a bandpass filter. As the data comes in, noise (high-low fluctuations in 

20 the measurements) which should be disregarded. The correct choice of KI and KD will 

provide a system that is more appropriately tuned for the nature of that data coming in, and is 
not necessarily responding to short impulse changes in the measurements. 

The {KD X D) factor of the R equation represents the derivative contribution to the R 
value. KD is a tuning constant 22. D^ is a value for that represents changes in proportional 
25 values over time, in other words, how fast the value is changing, and is calculated as follows. 
Di = (P- - P/old)/i. P/oId is a previous stored value for P/. t is time difference between the 
measurements used to calculation P/ and P/old, e.g. the interval sample time or the time 
between adjustment operations of the system. This factor is useful in adjusting the 
entitlements when the service level is changing over time. The factor determines how much 
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extra impulse to add to the proportional factor, when the curve is beginning to change. For 
example, if the application is increasingly being used over time (ramping up), then more CPU 
time (via entitlements) would need to be devoted to the application for goals to be satisfied. 
Using only proportionality, the system would lag behind demand, however the derivative 
5 factor would then provide the extra boost needed to catch up with demand. KD sets the value 
of the 'extra boost', depending on the steepness in the changes in the curve. Note that there is 
an assumption that the curve is moving in a certain direction, and thus, the steeper the curve, 
the higher the next value. KD should be selected to properly set the effects of the derivative 
factor. For further information, please see the reference by Benjamin C. Kuo entitled 
10 "Automatic Control Systems", 4*^ ed., 1982, Prentice-Hall Inc., Englewood Chffs, N.J., 
07632, ISBN 0-13-054817-0, which is incorporated herein by reference. 

The values for the proportional, integral, and derivative components are then added to 
the stored previous value for R, Rpld. The result is the R value for the particular goal, 
The PID controller would calculate one such value for each goal. 

15 After computations of the requirements or R values, Rl, R2, R3, the PID controllers 

24, 24, 25 pass the R values to the arbiter 26. In a system where the CPU resources outweigh 
the needs of the applications running on the system, then an arbiter is not needed, as the R 
values can be directly provided to the PRM. However, in most systems, there are periods of 
time where the applications requirements outweigh system CPU resources. Therefore, an 

20 arbiter is need to decide which applications are allocated the resources. Note that the arbiter 
does not actually make the allocations, as this task is performed by the PRM. Instead, the 
arbiter receives the R-values from the PID controllers and then adjusts the R-values, if 
needed, to form adjusted R-values. These adjusted R-values are then provided to the PRM 
which makes the allocations. 

25 The arbiter operates according to the flow chart 800 of FIGURE 8. Initially the 

arbiter assigns 801 all processes with the value 1 (hereinafter meaning 1% of CPU resources). 
The arbiter then samples 802 the requests or R values from the PID. The arbiter then 
examines 803 the requests associated with the applications in the highest priority group. It 
determines 804 whether the requested amount for each application within the priority group 
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can be satisfied. If so, then the arbiter facilitates allocation 805 of the requested entitlement 
for each application by setting the adjusted R-values equal to the PID R-values, and passing 
the adjusted R-values to the PRM, see step 809. If not, then the arbiter arbitrates between the 
different applications in a fair manner, as discussed in step 810. After satisfying each 
5 application in step 805, the arbiter then determines 806 whether there are any more priority 
groups. If so, then the arbiter retums to step 803 and repeats. If not, then arbiter determines 
807 whether any unallocated resources remain. If not, then the arbiter is finished 809. The 
allocated values are sent to the PRM, and the WLM is finished for this iteration. After a 
predetermined time period, the WLM will begin again, the WLM will sample values from the 

10 performance monitor, provide these values to the PID controllers, which in tum calculates the 
R values, which are then provided to the arbiter. If step 807 determines that resources are 
available, then the arbiter divides 808 the remaining resources equally among the applications 
of the all of the priority groups that have been examined. Step 808 assumes that the arbiter is 
set to distribute-all, Altematively, the arbiter can be set to hoard-all excess entitlements, in 

15 which case, all remaining allocations would be assigned to an extra shares application which 
contains random processes not assigned priorities or in the priority groups. Note that 
hoarding may allow the invention to operate more properly, as the assignment of extra 
entitlements may cause the applications to over achieve their respective goals, and 
consequently cause the application to unnecessarily revise the R-values. Then the arbiter 

20 ends 809. 

If the arbiter determines in step 804 that the requested amount for each application 
within the priority group cannot be satisfied, then the arbiter arbitrates between the different 
appUcations in a fair manner, by designating 810 a current target value as the lowest value of 
(1) the lowest of any previously allocated amounts (or adjusted values), wherein the 
25 previously allocated amounts have not been previously used a target value, or (2) the lowest 
requested amount (or R-value) of one application of the group, which has not been used for a 
previous current value. Note that criteria (1) and (2) do not include applications that have 
reached their requested amounts, as this will simplify the performance flow of the arbiter as 
depicted in FIGURE 8 (namely, by reducing the number of times that steps 810, 81 1, 812, 
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and 813 are repeated). Then the arbiter determines whether the target amount for each 
appUcation within the priority group can be satisfied. If not, then the allocation amount is 
equally divided 814 among different applications of the priority group whose allocations are 
less than the current target, but excluding applications that already met or exceeded the target 
5 level. The arbiter then ends 809. If so, then the arbiter allocates 812 sufficient entitlements 
to bring the adjusted R- value of each application up to the target level. Applications that 
already meet or exceed the target level are not changed. The arbiter then determines 813 
whether any unallocated entitlements remain. If not, then the arbiter ends 809. If so, then the 
arbiter retums to step 810 to determine a new current target level and repeats the process until 
10 the arbiter ends 809. 

FIGURE 9 is an example of the operation of the arbiter 26. As shown in FIGURE 9, 
there are six applications with four levels of priority. The PID system has supplied R- values 
for each of the applications which totals 164 or 164%. Since this is above the 100 or 100% 
allowed by the system, the arbiter 26 will have to reduce some or all of the R- values before 

15 they are sent to the PRM. Each application initially receives one share. The highest priority 
application, application A, requests 40 entitlement shares, since 94 shares have yet to be 
allocated, this application can be allocated its requested amount. Thus, application A is 
allocated an additional 39 shares for a total of 40. The next highest priority application, 
application B requests 29 entitlement shares, since 55 shares remain, this application can be 

20 allocated its requested amount. Thus, application B is allocated an additional 28 shares for a 
total of 29 shares. The next highest priority is priority 3, with three applications C, D, E, each 
of which requests 20 shares. Since only 27 shares remain, the arbiter must arbitrate the 
remaining shares. The current target is 20. Since the current target cannot be met, the 27 
shares are divided among the applications in this priority group, i.e. each receiving an 

25 additional 9 shares for a total of 1 0 shares. Application F retains its one share which was 

initially allocated to it. Note that the prior allocation amounts are not used in calculating the 
new allocation values. 

FIGURES lOA and lOB illustrate a more complex example of the operation of arbiter 
26 than that of FIGURE 9. Applications A and C have been allocated entitlement shares in a 
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previous round, namely during processing of priority 1 applications. Each application 
initially receives one share. The highest priority applications, application A and C, requests 
and receive a total of 10 and 15 entitlement shares, respectively (not shovra). The next 
highest priority application, application D requests 43 entitlement shares, since 73 shares 
5 remain, this application can be allocated its requested amount. Thus, application D is 

allocated an additional 42 shares for a total of 43 shares. The next highest priority is priority 
3, v^ith three applications A, B, C, each of which requests 20 shares. Note that this is a 
second goal for applications A and C, as higher priority goals have already been allocated 
shares. Since only 31 shares remain, the arbiter must arbitrate the remaining shares. The 

10 current target is 10, since the previous allocation of 10 is the lowest number of 10 (previous 
allocation), 15 (previous allocation), and 20 (requested amount). Since the current target can 
be met, application B receives 9 shares, and applications A and C are not changed. Since 
shares remain, the new current target is determined to be 15. Since this target can be met, 
applications A and B each receives 5 shares, and application C is not changed. Since shares 

1 5 remain, the new current target is determined to be 20. Since this target cannot be met, the 
remaining 12 shares are divided among the applications in this priority group, i.e. each 
receiving an additional 4 shares for a total of 19 shares. 

FIGURES 1 1 A and 1 IB illustrate a more complex example of the operation of arbiter 
26 than that of FIGURES lOA and lOB. Applications A, B, C have different requested 

20 values. Each application initially receives one share. The highest priority applications, 
application A B, and C, requests and receive a total of 10, 12, and 20 entitlement shares, 
respectively (not shown). The next highest priority application, application D requests 33 
entitlement shares, since 57 shares remain, this application can be allocated its requested 
amount. Thus, application D is allocated an additional 32 shares for a total of 33 shares. The 

25 next highest priority is priority 3, with three applications A, B, C, which have requests of 25, 
15, and 30 shares, respectively. Note that this is a second goal for applications A, B, and C, 
as higher priority goals have already been allocated shares. Since only 25 shares remain, the 
arbiter must arbitrate the remaining shares. Note that the first current target would be 10, 
which is the lowest of 10 (previous allocation), 12 (previous allocation), 15 (requested 
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amount), 20 (previous allocation), 25 (requested amount), and 30 (requested amount). 
However, all of the applications meet or exceed this level, thus operation of the arbiter 
according to FIGURE 8 would result in no changes, and the next lowest target of 12 would be 
selected. Otherwise, FIGURE 8 could be modified to include such a check and thus the next 
5 lowest value of 12 would be selected as the current target instead of 10. Nonetheless, assume 
that one of these two steps has occurred, and the current target is determined to be 12. Since 
the current target can be met, application A receives 2 shares, and applications B and C are 
not changed. Since shares remain, the new current target is determined to be 15, Since this 
target can be met, applications A and B each receives 3 shares, and application C is not 

10 changed. Since shares remain, the new current target is determined to be 20. Since this target 
can be met, application A receives 5 shares, and application C is not changed. Note also that 
application B is not changed because its requested amount has been reached. Since shares 
remain, the new current target is determined to be 25. Since this target can be met, 
applications A and C each receive 5 shares, and application B is not changed. Since shares 

1 5 remain, the new current target is determined to be 30. Since this target cannot be met, the 
remaining 2 shares are divided among the applications in this priority group, i.e. application 
C receives 2 shares for a total of 27 shares, since A and B have met their requested amounts. 

FIGURE 12A depicts the operation of the rounder 27 of FIGURE 3. The above 
examples have used integer values for the requests, allocations, and arbitrated R- values, 

20 however floating point number may be used, e.g. a R- value of 10. 1 . Also, floating point 
numbers may also result from step 814 (for example dividing 3 shares among two 
applications results in 1.5 shares for each application). Some systems may only operate with 
R-values that are integer, thus fractional values of shares will need to be rounded up or down. 
The rounder 27 first receives 121 the R-values from the arbiter 26. The rounder then 

25 cumulatively sums the values for each received R- value by adding prior R-values to each 
received R-value. The rounder then forms the rounded R-values by subtracting each 
cumulative sum with the prior cumulative sum. For example, as shown in FIGURE 12B, 
three apphcations have R-values of Rl = 33.5, R2 = 33.5, and R3 = 33.0. The rounder forms 
SI by adding Rl and 0 (note that step may be modified such that SI is assigned the value of 
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Rl) and then rounding wherein fractional values of greater than or equal to 0 and strictly less 
than .5 are rounded down to zero and fractional values of greater than or equal to. 5 are 
rounded up to one. Similarly, the rounder 27 forms S2 by adding R2 + Rl and rounding, and 
forms S3 by adding R3 + R2 +R1 and rounding. Note that any fractional values are being 
5 accumulated into the subsequent sums (before rounding), i.e. SI has .5, 82 has 1.0, and S3 
also has 1 .0 (before rounding). The rounder forms the rounded R- values, by subtracting the 
sums with the previous sum. Specifically, Rr = SI (or SI - 0), R2' = S2 - SI, and R3* = S3 - 

52. Note that the rounding up occurs in the first value, as this is where the accumulated 
fractional value has equaled or exceeded .5. 

10 FIGURE 12C is another example of rounding, wherein four applications have R-values 

of Rl = 10.1, R2 = 20.2, R3 = 30.3, and R4 = 39.4, The rounder forms SI through SI = Rl 
(or Rl + 0) and rounding, forms S2 through S2- R2 + Rl (or R2 + SI) and rounding, forms 
S3 through S3= R3 + R2 + Rl (or R3 + S2) and rounding, and forms S4 through S4= R4 + R3 
+ R2 H-Rl (or R4 + S3) and rounding. Note that any firactional values are being accumulated 

15 into the subsequent sums (before rounding), i.e. SI has .1 , S2 has .3, S3 has .6, and S4 has 1.0 
(before rounding). The rounder forms the rounded R-values, by subtracting the sums with the 
previous sum. Specifically, Rl' = SI (or SI - 0), R2* = S2 - SI, R3* = S3 - S2, and R4* = S4 - 

53. Note that the rounding up occurs in the third value, as this is where the accumulated 
fractional value has equaled or exceeded .5. Note that the rounding is order dependent. 

20 Rounding tends to occur during subsequent applications, as the fractional values from several 
applications are usually needed to accumulate before the rounding value (i.e. .5) is reached. 
Consequently, the ordering of the applications determines which application will receive the 
rounding. For example, give the following fractional values of .4, 0, and .1, the third 
application with . 1 will receiving the rounding up, as this accumulation value is the one that 

25 equals or exceeds .5, and not the larger fi-actional value of .4. If the application were re- 
ordered to 0, . 1 , and .4, then the third application with .4 would receive the rounding. Note 
that roimding does not cause significant perturbations to the inventive system, i.e. causing 
over/under achievements of the goals, unless the R-values are very small. In that case, 
increasing a small value by 1 would represent a large change in the percentage and may cause 
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over/under achievement. For example, suppose an R-value of 2.1 is rounded up to 3. This 
represents a value that is 143% larger than the allocated R-value. Such a large difference may 
cause over/under achievement. 

Note that the examples depicted and described herein are for illustrative purposes only, 
5 as the invention will operate with other values. 

Further note that the allocation mechanism shown in FIGURE 8 and illustrated with 
examples shown in FIGURES 9 to 1 IB, is designed such that each appHcation within a 
priority group will receive generally equal treatment. Alternatives can be developed. For 
example, the arbiter could be programmed to attempt to maximize the number of applications 

10 that receive their request amount. This would starve some of the applications within the same 
priority group, particularly the larger requesting applications, so that others, namely the 
smaller requesting applications, will be satisfied. Another altemative is to have applications 
receive an amount that is proportional to the difference between their allocated amount and 
their requested amount. When a priority level is reached where there is an insufficiency in the 

15 available share verses the requested shares, then allocating an amount that is proportional for 
the difference would put each application at the same fractional point. This would minimize 
the number that receive the amount they are asking for because, none of the applications 
would receive the whole amount they are requesting (subject to rounding), they would all be 
scaled by their respective differences. The advantage of the mechanism of FIGURE 8 is that 

20 no application is sensitive to any other application (with increasing requirements) at the same 
priority or lower priority. Note that a smaller requesting application may reduce a higher 
entitlement application, of equal priority, until their respective allocations become equal. If a 
higher priority application starts requesting more shares, then the lower priority application 
will lose shares, but if an application at the same priority starts requesting more share, then 

25 this application can reduce only the shares of its co-priority applications if its entitlement is 
smaller than theirs. Thus, co-priority applications are protected from each other. With the 
altemative mechanisms described above, a particular application's allocations will be affected 
as the request of their co-priority applications are changing. 
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FIGURE 4 depicts the service level 40 of an application and changes to the service 
level from operation of the invention. This application has a performance characteristic with a 
goal of 2. This characteristic could be time or cycles for completion. The initial entitlements 
were set low, and thus the characteristic exceeded the goal, which is undesirable. However, 
5 the invention increased the entitlements and thereby reduced the time characteristic down to 
the goal. Note that this goal is a "less than" goal, meaning that an increase in entitlement 
shares will reduce service level, i.e. reduce the measurement. Further note, that if the goal is a 
"greater than" goal, meaning that an increase in entitlement shares will increase the service 
level, then FIGURE 4 can be viewed as a case where the initial entitlements were set high, and 
1 0 the invention decreased the entitlements and reduced the characteristic down to the goal. 

FIGURE 5 depicts the service level 50 of an application and changes to the service 
level from operation of the invention. This application has a performance characteristic with a 
goal of 2, This characteristic could be time or cycles for completion. The initial entitlements 
were set high, and thus the characteristic was less (better) than the goal. However, the 

1 5 invention decreased the entitlements and thereby increased the time characteristic up to the 
goal. Note that this goal is a "less than" goal, meaning that an increase in entitlement shares 
will reduce service level, i.e. reduce the measurement. Further note, that if the goal is a 
"greater than" goal, meaning that an increase in entitlement shares will increase the service 
level, then FIGURE 5 can be viewed as a case where the initial entitlements were set low, and 

20 the invention increased the entitlements and raised the characteristic up to the goal. 

Both FIGURES 4 and 5 depict circumstances where an initial entitlement yielded 
performance results that are different from the stated goal; however, in a relatively short 
period of time, the goal is reached. Consequently, the initial settings for the entitlements 
becomes less important as the invention will quickly adjust the entitlement to meet the goal. 
25 However, the tunings for the PID controller are important, particularly KP. As shown in 
FIGURES 4 and 5, adjustments are made step by step, gradually, and the severity of the 
change is govemed by the KP quantity. The invention makes big changes at first, and slowly 
begins getting closer and closer to the goal. If KP is set too low, then the invention will take a 
longer time to reach the goal, i.e. the smaller ATP means slower convergence. Thus, the larger 

817007.1 




Attorney Docket No. 1 099209 1 PATENT 

20 

KP the faster the convergence. Fast convergence is more desirable, of course, to the user. 
However, if KP is set too high, then an unstable application may result. FIGURE 6 depicts an 
application operating on the invention with KP set too high. Consequently, the invention 'over 
corrects* for the differences between the measurement and the goal, and is oscillating around 
5 the goal. Therefore, if the system is not responding quickly enough, the user may want to 
increase KP, while if the system is prone to instability, then KP can be reduced. 

The following discusses the selection of the KP constant. Selection of the KI and KD 
constants can be readily performed based on the information contained herein, as well as that 
of the reference by Benjamin C. Kuo entitled "Automatic Control Systems", 4^^ ed., 1982, 
10 Prentice-Hall Inc., Englewood Chffs, N.J., 07632, ISBN 0-13-054817-0, which is incorporated 
herein by reference, particularly chapter 8.2. 

Two points are of interest when choosing KP. These points are the service levels U 
and L, which represent the upper and lower bounds on the service levels. Note that for a 
service level based on time or "less than", U is effectively infinite, since the service level 

15 becomes arbitrarily large as the entitlement approaches zero. Hence, to get a reasonable upper 
bound, we must choose a more limited range of points we are interested in. The upper and 
lower service levels, U and L are identified, as well as Eu and El, which are the entitlements at 
which the upper and lower service levels are achieved. In the example fi*om above, we had a 
workload that we expected to produce two-second transactions when given a portion of the 

20 CPU entitlements. Empirical data fi-om this workload suggests that it has an asymptote around 
zero shares or the service level increases without bound as entitlement approaches zero. So 
suppose that we limit our region of interest to the range of entitlements starting at ten 
entitlement shares. This corresponds to service levels below roughly six seconds, under the 
workload conditions in the experiment. In this example, we wind up with the following 

25 parameter values: U- 6.00, L= .068, Eu = 10, and El = 99. 

It is asserted that if KP is larger than 2/M, where M is the absolute value of the slope 
of the performance curve near the goal G, then the system will not converge to the goal. Note 
that the following calculations assume a "less-than" goal, however the calculations for a 
"greater-than" goal are similar. Since we are considering points near the goal, the 
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performance curve in this region can be expressed as S(e) = G + M * (Eg - E), where Eg 
represents the entitlement that corresponds to the goal. Suppose KP is larger than 2/M. Also, 
suppose the service level is currently S and the entitlement is E. This will result in an 
entitlement change of {KP * (S-G)) sheires. That is, the new entitlement will be: 

5 Enew = E + (KP * (S-G)) 

Given the above performance curve formula, we also know: 

S = G + M * (Eg - E) 

Instability will result if Enew is further from Eg than E was. That is, if: 

I Enew - Eg I > I E - Eg I 

10 This is equivalent to: 

I Enew - Eg I > I E - Eg I 
|E + (/i:P*(S-G))-Eg|>|E-Eg| 
I E + (ATP * ((G + M * (Eg - E)) -G)) - Eg | > | E - Eg | 
I E - Eg + (KP * M * (Eg - E) I > I E - Eg I 
15 1(1 -/:P*M)*(E-Eg)|>|E-Eg| 

I (1 - /;:P * M) I * I (E - Eg) I > I E - Eg I 
\(l -KP*M)\>1 

That is, if I 1 - KP * M | > 1, then the entitlement "error" will be bigger than before, and 
therefore the system will be unstable. 

20 Now if KP> 2/M, then: 

KP*M>2 
ATP * M -1 > 2 - 1 = 1 
I a:p * M -1 1 > 1 

As we showed above, this condition implies that the system will be unstable. Similar 
25 calculations can be used to show the same result for a "greater-than" workload. Hence, if KP 
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is larger than 2/M, the system will not converge to the goal, since the entitlement will always 
move further from the goal value. 

The following describes an upper bound for KP. Recall the parameters U, L, Eu, and 
El that we computer for our workload. If we assume the performance curve is continuous, 
5 then by intermediate value theorem, there must be some point Em between El and Eu at which 
the slope of the performance curve is (U - L) / (Eu - El). So if the goal is set to the service 
level which corresponds to Em, then from the above equations, the system will be unstable for 
any value of KP larger than 2 | (Eu - El) / (U - L) |. So the following constraint is 
recommended: 

10 XP<2|(Eu-El)/(U-L)| 

Following this limit will avoid creating a scenario where a goal can be chosen between L and 
U which is certain to lead to instability. Note, however, that this does not guarantee stability 
for all goal values and all KP values less than this limit. In fact, it is likely that KP values near 
this limit will still result in an unstable system. This limit tells us how to avoid configurations 
15 that are definitely unstable. It also gives an initial sense of how large KP should be, e.g. 
whether it should be around a million or a millionth. 

For the example values we determined above, we get the following bound for KP: 

< 2 I (10 - 99) / (6.00 - 0.68) | = 33.46 

This means that to get reasonable behavior for all goals under six seconds, we should avoid 
20 setting KP to a value bigger than 33.46. 

The following describes a starting point for KP. The upper bound we have determined 
is of limited use, since it only tells us values that should not be chosen. Choosing an actual 
value requires deciding how aggressively to tune the system, weighing the trade-off between 
stability and timely resource adjustments. One way to estimate an appropriate value for KP is 
25 to analyze the system as if it is a continuous linear system. 

Again, suppose the performance curve is given by the simple formula S(e) = G + M * 
(Eg - E). For this computation, we need a time-independent representation of the rate at which 
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we change service levels. Let K represent the entitlement change per second, given a service 
level error of 1 . So if the data collector is reporting data within every interval, K would be 
ArP/wlm_interval (which is the collection or reconfiguration interval of the wlm). So for any 
interval of time delta_t, the entitlement will be adjusted by roughly K * delta_t * (S - G). The 
5 resulting change in service level will be: 

delta_S = Snew - S + (G + M * (Eg - Enew)) - (G + M * (Eg - E)) 

- M * (Eg - Enew - Eg + E) 

= M * (E - Enew) 

= M * (E - (E + K * delta_t * (S - G))) 

10 = M * (K * delta_t (G - S)) 

So 

delta_S / delta_t = M * K * (G - S) 

Taking the limit as delta_t goes to zero, we have: 

S'=M*K*(G-S) 

15 This differential equation can be rewritten as: 

S' + M*K*S-M*K*G = 0 

The solution to this differential equation is: 

S(t) = G + B*e^(-M*K*t) 

where B is a constant whose value is determined by the initial conditions. Specifically, when t 
20 = 0, we have S(t) = G + B, so B represents the initial deviation from the goal. To make use of 
this formula, it is necessary to quantify our desired rate of convergence. One way to represent 
the rate of convergence is to consider how long the system should take to converge to within 
ten percent of the goal. For example, if we want the workload to get within ten percent of the 
goal in under two minutes (120 seconds), then we want the following: 

25 |S(120)-G|<0.1 *G 
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This is equivalent to: 

|GH-B*e^(-M*K* (120)) - G | < 0.1 * G 

I B * e ^ (-M * K * (120)) | < 0,1 * G 

We now need to place bounds on the value of B. We expect the service levels to fall between 
5 L and U. The goal falls between these values as well. Since B represents the deviation from 
the goal at t = 0, B can be at most | U - L |. Therefore: 

I B I * I e ^ (-M * K * (120)) |<|U-L|*|e^(-M*K* (120)) | 

So if we ensure that the right hand side above is less than (0.1 * G), the convergence will be 
within the desired time. So we are trying to achieve: 

10 I U - L I * I e ^ (-M * K * (120)) | < 0.1 * G 

which is equivalent to: 

e ^ (-M * K * (120)) |<0.1*G/|U-L| 

-M * K * (120)1 < ln(0.1 * G / I U - L I) 

K > - ln(0.1 * G / I U - L I) / (120 * M) 

15 As before, we can use | (U - L) / (Eu - El) | as an approximation for M. Since any K satisfying 
the above will provide the desired level of convergence in the desired time, we can choose the 
smallest (most conservative) such K: 

K = -hi(0.1 * G / I U - L I) * I (Eu - El) / (120 * (U - L)) | 

For the specific example we have been using, we get the following value, supposing a goal of 
20 two seconds: 

K = -ln(0.1 * 2 / I 6.00 - 0.68 |) * (10 - 99) / (120 * (6,00 - 0,68)) | = 0.4574 

The general formula for any time interval T (120 seconds above) and accuracy A (0.1 above) 
is: 

K = -In ( A* G/ I U-L |) * | (Eu-El)/(T*(U-L))| 
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To determine KP, we need to scale K for time. Let J be the average number of seconds 
between entitlement changes for the workload. This may or may not be wlm_interval, 
depending on how often the data collector reports data. As we observed earlier, 

¥. = KPn 

5 Hence, 

KP = K* J 

In summary, given the following parameters: U = Maximum expected service level, L 
= Minimum expected service level, Eu = Entitlement producing service level U, El = 
Entitlement producing service level L, G = Service level goal, T = Desired convergence time 
10 (in seconds), A = Error (as percentage of G) within time T, and J = Average number of 
seconds between entitlement changes, then a reasonable initial estimate for KP is: 

iCP=-ln(A*G/| U-L|)* |(Eu-El)/(J*T*(U-L))| 

Note that the ln() in this expression is the natural logarithm, with base e. This formula 
can be rewritten with the "common" base- ten logarithm as follows: 

15 KP^ -2.30259 * log(A*G/ 1 U-L | ) * | (Eu-El) / (J*T*(U-L)) | 

Because of the oversimplifications made in the calculations that led to this formula, this initial 
value of AT may need to be fine-tuned to produce the desired behavior. However, it serves as 
a reasonable starting point. 

Note that the term 'application'' as used in the specification is a collection of processes. 

20 An example of an application is a database server, which may be one or more processes that 
are handling database lookup, store, database requests, etc. PRM includes a mechanism to 
describe which processes should be associated with an application based on characteristics 
such as what program they are running or what user is running them. There is also a way to 
manually say "run this process in a particular group." Consequently, an application is any 

25 collection of code that performs a function for a user or program, e.g. operating system. 

Example of applications are, but not limited to MS Word, Oracle, Apache Webserver, a utility 
such as SAP, or BAAN. 
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FIGURE 7 illustrates computer system 700 adapted to use the present invention. 
Central processing unit (CPU) 701 is coupled to system bus 702. The CPU 701 may be any 
general purpose CPU, such as an HP PA-8200 or Intel Pentium II processor. However, the 
present invention is not restricted by the architecture of CPU 701 as long as CPU 701 supports 
the inventive operations as described herein. Bus 702 is coupled to random access memory 
(RAM) 703, which may be SRAM, DRAM, or SDRAM. ROM 704 is also coupled to bus 
702, which may be PROM, EPROM, or EEPROM. RAM 703 and ROM 704 hold user and 
system data and programs as is well known in the art. 

The bus 702 is also coupled to input/output (I/O) controller card 705, communications 
adapter card 711, user interface card 708, and display card 709. The I/O card 705 connects to 
storage devices 706, such as one or more of hard drive, CD drive, floppy disk drive, tape 
drive, to the computer system. Communications card 71 1 is adapted to couple the computer 
system 700 to a network 712, which may be one or more of local (LAN), wide-area (WAN), 
Ethernet or Intemet network. User interface card 708 couples user input devices, such as 
keyboard 713 and pointing device 707, to the computer system 700. The display card 709 is 
driven by CPU 701 to control the display on display device 710. 

Although the present invention and its advantages have been described in detail, it 
should be understood that various changes, substitutions and alterations can be made herein 
without departing from the spirit and scope of the invention as defined by the appended 
claims. Moreover, the scope of the present application is not intended to be limited to the 
particular embodiments of the process, machine, manufacture, composition of matter, means, 
methods and steps described in the specification. As one of ordinary skill in the art will 
readily appreciate from the disclosure of the present invention, processes, machines, 
manufacture, compositions of matter, means, methods, or steps, presently existing or later to 
be developed that perform substantially the same fiinction or achieve substantially the same 
result as the corresponding embodiments described herein may be utilized according to the 
present invention. Accordingly, the appended claims are intended to include within their 
scope such processes, machines, manufacture, compositions of matter, means, methods, or 
steps. 
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